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Non-commutativity is ubiquitous in mathematical modeling of reality and in many cases same algebraic structures are implemented 
in different situations. Here we consider the canonical commutation relation of quantum theory and discuss a simple urn model of 
the latter. It is shown that enumeration of urn histories provides a faithful realization of the Heisenberg-Weyl algebra. Drawing on 
this analogy we demonstrate how the operator normal forms facilitate counting of histories via generating functions, which in turn 
yields an intuitive combinatorial picture of the ordering procedure itself. 
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1. Introduction 

Operator algebras constitute mathematical framework within 
which many modern theories are built. Probably the most spec- 
tacular one is quantum mechanics with operator formalism at 
the very heart of the theory JT|[2]| . The most unexpected, yet un- 
avoidable, characteristic that makes it so strange and successful 
at the same time is non-commutativity. It has many spectacular 
consequences, such as Bose-Einstein condensation, supercon- 
ductivity or photon correlations, to name but a few 0. These 
phenomena are aptly described in the second-quantized formal- 
ism by the creation a* and annihilation a operators satisfying 
the canonical commutation relation 



[a, a 1 '] = 1 



(1) 



> 



which has became the hallmark of non-commutativity in quan- 
tum theory. It defines the so called Heisenberg-Weyl algebra. 
This new quality, however, comes at a price - the order of com- 
ponents in operator expressions is now relevant and has to be 
meticulously traced in calculations. A common resolution to 
this problem is to standardize the notation by fixing the pre- 
ferred order of operators. An important practical example is the 
normally ordered form in which all creation operators stand to 
the left of the annihilation operators. We hasten to remark that 
in general reshuffling of components to such a form is quite a 
cumbersome task involving numerous commutations of type (JT]i 
that are usually hard to follow without proper combinatorial in- 
sights |4]|5j|6)- 

Non-commutativity is a common feature in mathematical 
modeling of reality; perhaps it should be even thought of as a 
rule rather than an exception. A good illustration are urn mod- 
els that are commonly used to conceptualize discrete probabil- 
ity through intuitive enumeration of histories, and hence are of- 
ten used for modeling various discrete phenomena 1 7 8,9]. In 
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the present Letter, we discuss elementary urn processes empha- 
sizing their intrinsic non-commutativity which, interestingly 
enough, is described by the same commutator as in Eq. (QJ. 
Therefore, urn models can serve as a straightforward combi- 
natorial realization of the Heisenberg-Weyl algebra. In many 
cases this kind of insights provide simple interpretations of ab- 
stract mathematical constructions. Here, we demonstrate how 
the operator normal forms provide efficient tools for counting 
urn histories, and vice versa - in turn we obtain an illustration 
of the normal ordering procedure itself. Throughout the Let- 
ter we draw on the methods of generating functions that are 
a convenient way of handling all sorts of enumeration prob- 
lems ifToifrnrrni. 

In short, the primary interest of this Letter is attached to an 
intriguing analogy between combinatorial urn models and the 
Heisenberg-Weyl algebra. It will be exploited to illustrate ab- 
stract normal ordering procedure that is often used in the op- 
erator formalism of quantum physics. The Letter is organized 
as follows. In Sect. |2]we discuss non-commutativity of single- 
mode urn models and provide representation of processes in 
terms of differential operators. Sect. [3] briefly introduces the 
normal ordering problem and its formal resolution in terms of 
recurrences and differential equations satisfied by the associ- 
ated generating functions. In Sect. [4] we establish a direct link 
between urn processes and the normal ordering procedure. Fi- 
nally, Sect.[5]summarizes the results and comments on possible 
developments. 

2. Urn model 

An urn is a container with a collection of objects, convention- 
ally called balls, whose contents can be modified by randomly 
withdrawing or putting objects in according to given rules. Evo- 
lution of such a system is probabilistic in nature and its descrip- 
tion comes down to enumeration of histories that can be fol- 
lowed by the system. It is best handled with the methods of 
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Figure 1: An urn containing three balls and two elementary operations: I) - 
withdrawing a ball, and X putting a ball in. There are three possible choices of 
a ball to take out, and only one way to put a ball in. 



In general we may also combine processes in parallel, i.e. at a 
given instant of time choose to perform one process or another. 
In other words, we assume that processes can be selected at 
random from a given collection denoted by H. To account for 
different probabilities with which (composite) processes may 
occur we allow for their copies in Iri. The numbers hf, count- 
ing copies of the same process < Hi ( in 'H describe their relative 
probabilities, shortly these will be denoted by 'H — Ya hk'Mk- 
For example, in the process 'H — 2 X 3 D + 5 XT>X probability 
that occurs X 3 D or XDX is as 2 : 5. 

2.2. Urn histories 

Clearly, applying a process 'H to an urn H many times one 
ends with an outcome which has some history behind, i.e. the 
record of events which happened in a series of steps. We will be 
interested in counting all possible histories according to which 
an urn may evolve starting from a given number of balls at the 
beginning and finishing with a given number of balls at the end, 
i.e. all histories 1A\ Ilk- More specifically, we define 



generating functions. Here we briefly formulate a single-mode 
urn model highlighting non-commutativity of elementary op- 
erations and discuss its representation in terms of polynomials 
and differential operators. The latter provide means for enumer- 
ation of urn histories and brings out connection with the normal 
ordering procedure as described in Sect. [4] For a comprehen- 
sive study of various aspects of urn models see Refs. |7J[S]. 

2.1. Urns and processes 

We consider urns H with distinguishable balls and will be 
interested in the number of elements a given urn contains F] For 
short, an urn comprising n balls will be denoted by U„. Con- 
tents of an urn may be modified by two elementary operations 
(see Fig. [TJ: 

• D - withdrawing a ball from the urn, i.e. H n H n -\ , 

• X - putting a ball into the urn, i.e. tl n U n+ \ . 

These elementary operations may be performed in se- 
quence and form a composite process, e.g. X 2 D 3 X 4 D = 
XXDDDXXXXD read from right to left stands for: "take a 
ball out, put four balls in, take three balls out, and then put two 
balls in". We will assume here that these operations are per- 
formed one-by-one, i.e. only one ball is taken out or put in at 
a time. Clearly, each such process may be realized in many 
ways since there are different choices of balls in the urn. We 
should also note that the order in which elementary operations 
are composed is crucial for the number of possible histories that 
may occur which is an evident sign of non-commutativity in urn 
models, e.g. there is one more possibility for T>X than for XT). 



1 Here we restrict ourselves to the simplest case of single-mode urns - con- 
sisting of balls of only one sort - as it best illustrate the generic way in which 
non-commutativity enters the stage. By considering balls of different sorts 
(multi-mode urns) one adds extra variety to the models, however the nature 
of non-commutativity remains the same. 



= # 



histories in n steps 
from urn HiXaHi 



(2) 



Enumeration of histories is a nontrivial task, especially if one 
needs to do it for a general number of steps. An elegant and ef- 
ficient way of encoding information about sequences is attained 
through their generating functions llT0l[T2l . Hence, for each n 
we define the multivariate generating functions 



G*\x,y) = YG^ k x 



11 



(3) 



and similarly the exponential generating function encompass- 
ing all the steps 



G(x,y,A) 



(4) 



In practice one often faces the problem of explicit calcula- 
tion or at least studying properties of these objects. In Sect. |4] 
we provide a simple scheme of finding generating functions of 
Eqs. ([3]) and Q deriving from the operator ordering method- 
ology described in Sect. [3] We note in passing that a typical 
issue addressed in this context concerns analysis of probabili- 
ties PrL of ending with urn Kk if started from K/ as the result 
of n iterations of a given process <H. It is defined by the ratio 



- M 



J l-~k 



An) 



2* G l^k 

which is simply expressed through G^ n \x,y) or G(x,y, A) as 
[x k y'] G {n \x,y) ^y'A"] G(x,y, A) 



(5) 



- l~>k 



MGW(lj) [y'A"]G(l,y,A) ' 



(6) 



from which all statistical properties, such as moments, asymp- 
totic, etc., can be derived by the methods of generating func- 
tions and asymptotic analysis lfT0l[l2ll . 
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2.3. Operator representation 

Urn models can be conveniently described in terms of poly- 
nomials and differential operators. Let us represent an urn 1A n 
containing n balls by the monomial x", and elementary opera- 
tions X and T> by multiplication X and derivative D operators 
respectively, i.e. 

U n «— » x n , 
D < — » D , 
X <— » X. 

Observe that acting with this representation of a composite 
process on x" we get a polynomial in which various terms cor- 
respond to the resulting urn multiplied by the number count- 
ing all possible histories in which the process could have oc- 
curred, e.g. for XXDDDXXXD we have X 2 D 3 X 3 D x n = 
(n + 2)(n + l)n 2 x" +l . Following this remark one concludes 
that the correspondence 

K < — > H(X,D) 

holds true for any process "Kj^j Accordingly, applying oper- 
ator H(X,D) to x" we get the polynomial which is the sum 
of monomials describing all possible results with coefficients 
counting histories in which the outcome could have occurred, 
e.g. for <H = 2X 3 D + 5XDDX one gets H(X,D)x n = 
(2X 3 D + 5XD 2 X)x" = 2n x n+1 + 5(n + \)n x". This simple 
analogy can be taken further to account for iteration of the pro- 
cesses fi inn steps, which boils down to the formula 

(H{X,D)Tx l = Y J G^- (7) 

k 

These observations are a direct consequence of the inten- 
tional choice to represent urns by monomials and elementary 
processes by multiplication and derivation operators respec- 
tively. It is dictated by the relations 

D x" = n x"- 1 , 

(8) 

Xx n = 

which reflect a simple combinatorial fact that: given an urn 1A n 
containing n balls one can (see Fig.[T]i 

• withdraw a ball from the urn (£)) in n possible ways, 

• put a ball into the urn (X) in one way only. 

Note also that in this way we gain a surprising combinatorial 
insight into the commutator 

[D,X] = l, (9) 

which simply means that there is always one more possibility 
to put a ball in and next take one out (£>X) than when imple- 
menting them in the reverse order (XD) by first taking a ball 
out and then putting one in (see Fig.[2]for illustration). 



2 Here, the symbol H(X, D) should not be understood as a function sensu 
stricto, but rather taken as a polynomial (or formal series) in non-commuting 
variables X and D. See Sect.Rlfor further discussion. 



In this way, we have established a direct correspondence be- 
tween the algebra of urn processes and the algebra of differen- 
tial operators. Moreover, since the multiplication and derivative 
operators provide a faithful representation of the Heisenberg- 
Weyl algebra we conclude that urn models likewise furnish a 
concrete model thereof, i.e. 

Algebra of Algebra of 

Urn Processes Differential Operators 

Heisenberg-Weyl algebra 

We will use this representation for effective treatment of gen- 
erating functions enumerating urn histories. It will be shown in 
Sect. [4] that finding of the latter is directly linked with normal 
ordering of the associated operator expression. For other com- 
binatorial realizations of the Heisenberg-Weyl algebra see e.g. 
Refs. lfl3l[T4l[T5l[T6l. 

3. Normal ordering procedure 

Operator ordering methods have their roots in quantum 
physics, where reshuffling of operator expressions offers calcu- 
lational and interpretative advantages. Normal forms are a com- 
mon tool e.g. in solving operator differential equations 015], 
coherent state representation lTT7l [18l [T9l or quantum field the- 
ory 1 20, 21 1. It should be clearly noted that the ordering pro- 
cedure is a purely combinatorial task as it comes down to the 
repeated use of the commutator (see Ref. [6| for a gentle in- 
troduction to the problem and combinatorics hidden behind). 
Below, we briefly state the normal ordering problem and pro- 
vide its formal resolution in terms of generating functions and 
differential equations which will have a direct application to 
enumeration of urn histories in Sect. [4] 

3.1. Normal order 

Operator ordering issues are commonplace in the second 
quantized formalism of quantum theory where the fundamen- 
tal elements, the creation and annihilation operators acting in 
the Fock space, constitute the Heisenberg-Weyl algebra. This 
brings about ambiguity in representation of operators as al- 
gebraic expressions in a and a' since the defining relation of 
Eq. ([!} allows for different arrangements thereof, e.g. aa' and 
a* a + 1 stand for the same operator. The problem is usually 
resolved by fixing the preferred order of components. Conven- 
tionally, it is done by choosing the normally ordered form in 
which all annihilators stand to the right of creators, thus pro- 
viding a unique representation of an operator in the form 

A = a rs a fr a s , (10) 

r,s>0 

We note that the procedure of reshuffling of components using 
Eq. ([T]) to the normal form yields an operator whose action is 
equivalent to the original one. However, we hasten to remark 
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that, in general, this is a highly nontrivial task involving numer- 
ous intricate commutations which without appropriate combi- 
natorial insights are hard to follow through [4, 5, 6][^] 

The Heisenberg-Weyl algebra of Eq. (JJJl has a faithful repre- 
sentation in the space of polynomials (formal power series) by 
taking 



D, 
X, 



where D = d x and X are the derivative and multiplication oper- 
ators defined in Eq. ([8]). This realization is of particular interest 
to us as it provides a link to urn processes demonstrating a com- 
binatorial content of the commutation relation of Eqs. ([TJ or Q. 
In this case the problem of operator ordering is tackled in anal- 
ogous way as for the creators and annihilators. Accordingly, 
we henceforth standardize the notation of an operator H(X, D) 
given by some expression in operators X and D to its normally 
ordered form in which all multiplication operators X stand to 
the left of derivative operators D. Clearly, each H can be unam- 
biguously put in this form, i.e. 



H(X,D) = Yj h,X k D' . 



(11) 



k,l>0 



Note that this is an operator identity. In the language of urns 
one can think of it as the replacement of a possibly very com- 
plex urn process Iri by a collection of single-shot processes 



3 This is contrary to the so called double dot operation, denoted by : ... : , 
which also consists in reshuffling components to the normal form but this time 
without taking into account the commutation relation of Eq. i.e. moving 
all annihilation operators a to the right as if they commuted with the creation 
operators a ' . Clearly, the procedure is trivial to perform, but with an important 
caveat that the resulting operator is different from the original one (except for 
operators already in the normal form). Therefore, the double dot operation is 
not of a direct use in calculus. See Ref. [22] for discussion. 



X k D l which withdraw I balls all at once and then replace them 
with k new ones. Clearly, the latter is to be equivalent to the 
original one in a sense that it provides the same number of 
histories (now partly accumulated in the weights ha). By the 
normal ordering of an operator we mean the procedure - what- 
ever complex it might be - of moving all the derivatives D to 
the right using the commutation relation of Eq. (|9]). Below we 
provide a scheme of finding normal forms of powers and expo- 
nentials of operators. 

3.2. Ordering of powers and exponentials: Formal resolution 

Finding of normally ordered forms is facilitated if there is 
some structure in the expression. Powers and exponentials are 
exemplary of such a situation since they are constructed by sim- 
ple iteration. Here, we show how to exploit this pattern to obtain 
normal forms by means of recurrences and partial differential 
equations. 

Suppose we are given an operator H = H(X,D) as in 
Eq. (Hi, and look for its n-th power in the normally ordered 



form, i.e. 

H" = H"(X, D) 



2 X k D' . 



(12) 



k,I>0 



Note that, for each n = 0,1,2,..., the right-hand side of 
Eq.(|T2|> is uniquely determined by the sequence of coefficients 

/ /) ^ ■ • - TJ e\nr*a oil thoco nrmmfe oar* V*£i on rrxriarl \*t\T a 



)k,l>0- 



Hence, all these powers can be encoded by a se- 



quence of polynomials 
B„(x,y) = Yj h U x 



V, 



n = 0,l,2,.... 



(13) 



M>0 



Therefore, the problem of normal ordering of H" boils down to 
finding polynomials B„(x,y), since we have 



H"(X,D) 



B„(X,D). 



(14) 
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where the right-hand side taken in the normally ordered form 
(i.e. under the double dot product, see footnote [3). Similarly, 
the exponential generating function of the polynomials B„{x,y) 
defined as 

°° A" 

B(x,y,A)=YB n (x,y)-, (15) 
is straightforwardly related to the normal form of the exponen- 



tial of H — H(X,D) which, by the virtue of Eq. ( 14 1, is given 
by 



in 

e AH (X, D)=} H'\X, D) — = B(X, D, A) . 



(16) 



n=0 



Below, we give solutions to the problem in terms of recursion 
for polynomials B„(x,y) and differential equation for B(x,y,A). 
Observe that each B„(x,y) satisfies the identity 



B n (x,y) = e- xy H'\X,D)e x 



(17) 



which steams from the fact that the right-hand side of Eq. ( 12 1 is 



in the normal form and hence derivatives are readily performed 
(D = d x ). With this representation we may derive the recur- 
rence for the polynomials B„(x,y). We have 

B n+X (x,y) = e- xy H n+ \X,D)e xy 

= e- xy H{X, D)e xy e- xy H n (X, D)e xy 
= e~ xy H{X, D)e xy B n (x, y) , 



which by exploiting the normal form of Eq. (Ill and the prop 



erty D'e xy = e xy (D + yy provides the recurrence 

B n+1 (x,y)=H(X,D + y)B n (x,y), 
B (x,y) = 1. 



(18) 



With this result we can easily handle the exponential generating 



function of Eq. ( 15 1. By differentiating B(x,y, A) with respect 
to A and making use of the recurrence of Eq. (fT8]l we get 



d A B(x,y,A) = Y B„ + i (*,>>) — 



n=0 



= V H(X,D+y)B„(x,y)^-, 



which upon replacement X = x and D = d x yields the partial 
differential equation 



d A B(x, y, A) = H(x, d x + y) B(x, y, A) , 
B(x,y,0) = 1 , 



(19) 



satisfied by the exponential generating function of the polyno- 
mials B„{x,y). 



In summary, Eqs. ( 18 1 and ( 19 1 provide a formal solution of 
the normal ordering problem for powers and exponential of a 
given operator H - H(X, D) whose normal forms are given by 



the respective generating functions in Eqs. ( 14 1 and ( 16 1 



4. Enumeration of urn histories 

Here, we get round to enumeration of histories in urn pro- 
cesses by means of generating functions. It will be shown to be 
equivalent to finding normal forms of the corresponding opera- 
tor representation. 

In Sect. 2.2 we have defined the generating functions 



G^ n \x,y) and G(x,y, A) encoding the number of histories, G\ 
of an iterated process 'H (see Eqs. Q and Q). Then, in 
Sect. 2.3 we have discussed representation of a process <H in 



terms of differential operators H(X, D) and interpreted its ac- 
tion on monomials in Eq. i.e. 



H"} 



Z 



°l~*k X 



Let us multiply this equation byy'/ll and sum over/. This yields 
useful operational formulas for generating functions of urn his- 
tories of Eqs. |3]l and Q which read 



G M (x,y) =H n e x 



(20) 



and (further multiplied by A"/n\ and summed over n) 

G(x,y,A) = e AH e xy . (21) 



Clearly, for efficient use of Eqs. ( |20[ > and ( 2 1 1 one needs to know 
the action of the operators H" and e' m on functions (here on 
exponentials e xy ). It becomes trivial when the normally ordered 
form of the operator is known. In such a case, from Eqs. ( [T4| 
and ( fTo*] ) we have 



G {n \x,y) = B n (x,y)e x 



and 



G(x,y,A) = B(x,y,A)e xy . 



(22) 



(23) 



This means that calculation of G ( "^(^,y) and G(x,y, A) comes 
down to finding B„(x,y) and B(x,y, A) which solve the asso- 
ciated normal ordering problem (the only difference being the 
multiplicative factor e xy ). Note that the relevant solutions are 
given by Eqs. ( [T8| i and ( fT9} . 

In this way, we have demonstrated a direct link between enu- 
meration of urn histories in the iterated process and normal 
ordering of powers (or exponentials) of the associated operator 
H(X, D), i.e. 



Enumeration of 
Urn Histories 



Finding Operator 
Normal Forms 



This relation is reciprocal, which means that solving of either 
one provides solution of the other. For example, we can use 



results of Sect. 3.2 for enumeration of urn processes as indi- 
cated above. But there is more to that! This equivalence allows 
for illustrating problems one by another. Remarkably, from this 
perspective urn models furnish an intuitive combinatorial pic- 
ture of the otherwise abstract operator ordering procedure. We 
note that this analogy derives from the same algebraic structure 
which underlies both problems, i.e. the commutator of Eqs. ([T]l 
or ([9]) defining the Heisenberg-Weyl algebra. 



For example, let us consider the following urn process *H = 
XT) + g X + g T). It corresponds to the quantum Hamiltonian 
H = a* a + g (a^ + a), which describes an oscillator driven by 
the external force - a simple model of a system coupled to the 
environment 0. Here, particularly interesting is the picture of 
dynamics generated by H when recast in terms of urn histories. 
It translates into the process 'H in which at each step one ball 
can be either inspected, added or removed, with relative weights 
1, g and g respectively. Inspection (XT)) stands for just drawing 
a ball, looking at and then putting it back into the urn - hence 
in no way affecting number of the balls in the urn - represent- 
ing a free (undisturbed) evolution of a system. The remaining 
two terms introduce disturbance into the scheme by a random 
addition X or removal T) of a ball, interpreted as the effect of an 
external factor. Consequently, number of balls in the urn may 
change and urn histories proliferate which is conveniently de- 
scribed by generating function of Eq. Q. Following the above 
scheme from Eqs. 



19 1 and (23 1 we get the solution 



G(x,y,A) = e 



(x+g)(y+g)(e A -\) e -g 2 A e xy 



(24) 



We note that having found the generating function, statistical 
properties of the model can be derived by methods of combina- 
torial analysis IflOll . 



5. Summary and Outlook 

The recurrent theme of the Letter is a combinatorial approach 
to the canonical commutation relation of Eqs. ([T]l or i9). We 
have demonstrated that the Heisenberg-Weyl algebra can be 
concretized in terms of a simple one-mode urn model in which 
evolution is generated by taking balls in and out. It has been 
shown that the main concept of the model, which is enumer- 
ation of urn histories in a given process, if translated into the 
language of polynomials and differential operators can be con- 
veniently treated by the methods of generating functions. In 
this context we introduced the notion of operator normal form 
and discussed its formal resolution in terms of recurrences and 
partial differential equations given in Eqs. ( 18 i and ( 19 1. This 



in turn paved the way for finding generating functions encoding 
urn histories as indicated in Eqs. ( 22 1 and ( 23 i - in fact the tasks 
have been proved to be equivalent. 

In this way, we have shown that these two at first seeming 
unrelated problems may draw on specific methods and insights 
taken one from another. From one side, combinatorial enumera- 
tion of urn histories is greatly facilitated if the normally ordered 
form of the associated operator is known. On the other hand, 
the abstract mathematical notion of operator ordering gains a 
straightforward interpretation as enumeration of urn histories. 
The heart of the matter is that the underlying algebraic con- 
cept of the commutator allows for such a simple combinatorial 
realization. For some other concrete models of the Heisenberg- 
Weyl algebra see e.g. Refs. [13] \U\ (graphs), 03) (lattice 
paths), ifTBI (data structures), and Ref. |23 1 for a generic scheme 
leading from discrete objects to algebraic structures. 

Here we have only focused on the algebraic aspect of the urn 
model. However, the genuine idea of combinatorial modeling 



of abstract mathematical structures may have versatile applica- 
tions. In particular, it should be attractive to quantum physics 
whose abstract formalism seems lacking an intuitive grip. We 
leave this domain for future study. For some original research 
applying ideas of discrete mathematics to quantum foundations 
see Refs. Il24ll25ll26ll27ll28ll. 

Anticipating further analogies we observe that multi-mode 
systems can be modeled by urns containing balls of different 
sorts, e.g. each mode having different colour. In that case, 
mixing terms in the Hamiltonian, introducing entanglement be- 
tween quantum systems that are represented by different modes, 
can be modeled as processes swapping between different sorts 
of balls in the urn. We expect that at least some of the bizarre 
phenomena, typically ascribed to the quantum realm, may un- 
fold in a more intuitive way if looked from this simple combi- 
natorial perspective. 
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